FCB  61  R H PRARCR 

UNCLASSIFieO  NEL-’1016  NL 


ICF  I 

aSk  IOI 


! r. 

L‘ . . . 


,^^-^^<EyEy\RCH  y^D_£EVELOT14^ 

" jj'^  ij I '■'■)'■'  p 'i»cf  — 3 ~ ? 


^ f^r-  .■ 

ji/,.  /-■// 


O C'  EFFECTS  OF  RANDOM  BACKGROUND  ON  pTOMATIC, 
DETECTION  IN  L0RAD.(U| 


iV  ■ \ 


'■  R.  HyPrager  / 


r . ■■ 


\r 


/IC^ 


526'li8^5J 

U.  S.  NAVY  ELECTRONICS  LABORATORY,  SAN  DIEGO,  CALIFORNIA 


A.  tUREAU  OF  SHirS  LABORATORY 


. • J 

0.  • v U:v.^.  ir.v. 


UHCLASSlFiED 


A-)  - 


DOWNGRADED  AT  3-YEAR  ir.TERVALS 
DECLASSIKIED  after  12  YEARS 
DOD  DIR  52C0.10 


Develop  analytical  techniques  for  treatment  of  target  detec- 
tion and  classification  processes.  In  particular,  derive 
probability  models  required  for  analysis  of  automatic  detec- 
tion procedures  in  the  Lorad  system 


RESULTS 


\ 

liie  singie-ping  false  axarm  performance  of  the  Lorad 
system  has  been  analyzed.  Formulas  are  presented  which 
give  the  false  alarm  rates  resulting  from  specified  detec- 
tion criteria.  The  treatment  encompasses  analog  processes 
as  well  as  computer  programs . 

2.  A probability  model  has  been  developed  which  is  applicable 
to  a wide  variety  of  search  systems  which  process  data  in 
sampled  form.  In  addition,  these  techniques  are  applicable 
to  automatic  target  classification  processes. 

4 

RECOMMENDATIONS 


1.  Apply  the  techniques  to  other  sonar  systems:  SQS-23 
modified  for  use  with  Small  Ship  Combat  Data  System  (SSCDS); 
SQS-26. 

2.  Apply  the  methods  to  target  classification  processes  in 
Lorad. 

3-  Develop  detection  probabilities  for  the  Lorad  system  and 
couple  these  with  false  alarm  characteristics  derived  in 
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IlfTRODUCTION 


I 

As  part  of  the  design  of  an  operational  noise -correlation 
Lorad  system,  a set  of  test  programs  for  the  AIi/USQ-20 
computer  is  being  prepared  to  investigate  the  requirements 
for  automatic  detection  (and  ultimately  classification)  of 
possible  target  echoes.^  (See  list  of  references,  p.42  •) 

In  the  absence  of  substantial  empirical  data  on  the  charac- 
teristics of  random  noise,  reverberation,  and  submarine 
echoes  at  the  output  of  such  a noise-correlation  system,  the 
detection  criteria  being  used  are  based  on  assumptions  about 
the  complex  statistical  properties  of  the  background  and 
signals.  Many  of  the  mathematical  considerations  applying 
to  automatic  detection  hai^’e  also  entered  into  studies  of 
Lorad  display  systems . Some  theoretical  investigations  have 
therefore  been  undertaken  in  this  area.  The  initial  results, 
dealing  with  the  effects  of  random  backgrounds  on  automatic 
single-ping  detection,  are  presented  here. 

In  broad  terms,  the  computer  program  to  be  considered 
examines  the  returns  from  a region  of  the  ocean  consisting  of 
a 32°  sector  in  bearing  and  three  convergence  zones  in  range . 

On  a single-ping  basis,  this  program  attempts  to  detect  and 
retain  in  memory  possible  submarine  target  echoes.  These 
potential  target  echoes  from  a sequence  of  pings  may  then  be 
presented  on  a visual  display  with  which  an  operator  may 
detect  targets  on  the  basis  of  track  information.  The  follow- 
ing paragraphs  will  review  the  pertinent  features  of  Lorad 
operation,  describe  in  more  detail  the  computer  program  of 
interest,  and  pose  the  theoretical  questions  which  are  to  be 
discussed. 

The  processing  of  returns  prior  to  entering  data  into  the 
computer  will  be  described  first.  The  transmitted  signal  is 
a pulse  with  a nominal  duration  of  5 seconds,  obtained  by 
filtering  a 100-c/s  band  from  the  output  of  a pseudo -random- 
noise  generator.  The  pulse  is  transmitted  in  a 30'’  sector 
which  is  processed  in  the  receiver  in  the  form  of  sixteen 


Reference  1 contains  a more  detailed  description  of  Lorad 
and  of  the  computer  programs . Although  much  of  the  material 
in  the  Introduction  is  taken. with  only  minor  modifications, 
from  the  reference,  it  is  repeated  here  for  the  sake  of 
completeness . 
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2°  beams.  Tiie  receiver  is  open  for  70  seconds,  corresponding 
to  a total  range  coverage  of  56,000  yards.  Each  beam  is 
s;impled  every  5 milliseconds,  or  every  4 yards  in  range. 

The  samples  are  stored  in  l6  signal  deities,  each  of  which 
contains,  say,  1000  sramples  corresponding  to  the  transmitted 
pulse  duration  of  5 seconds.  Each  deltic  is  updated,  then, 
every  5 milliseconds;  i.e.,  the  oldest  sample  is  discarded 
and  the  new  sample  is  added.  During  the  5-msec  interval 
between  samplings,  the  contents  of  all  l6  signal  deities  are 
correlated  against  the  contents  of  eight  range -rate  reference 
deities.  (Actually,  there  are  2k  references,  since  three 
frequency  bands  are  employed  to  achieve  a higher  data  rate 
for  the  system.  However,  this  need  not  enter  into  the 
discussion  here.)  These  references  correspond  to  6-knot 
range -rate  intervals  between  minus  21  knots  and  plus  27  knots. 
Correlations  are  thus  performed  at  the  rate  of  25,600  per 
second,  and  1,792,000  correlations  are  performed  per  ping. 

The  correlations  are  performed  in  a "series -parallel"  fashion; 
the  first  beam  is  correlated  with  all  eight  references  simulta- 
neously, then  the  second  beam,  and  so  on. 

Each  correlator  output  is  passed  through  a comb  filter  for 
s Lgna ! -to -noise  ratio  impro’/ement , and  the  teeth  of  the  comb 
are  recombined  in  an  OR  circuit. ^ The  correlator  outputs, 
which  have  a center  frequency  in  the  megacycle  region  as  a 
result  of  the  time  compression  processing,  are  thrn  rectified 
and  lowpass  filtered  to  the  band  0-200  c/s.  The  eight 
correlation  values  for  a gi^'-en  beam  are  th<  n OR-circuit 
processed  so  that  only  the  largest  \’alue  is  retained.  This 
reduces  the  data  rate  to  3200  correlation  values  per  second, 
or  224,000  correlation  values  per  ping.  These  correlation 
values  are  submitted  to  an  amplitude  threshold  (analog), 
called  "t,"  which  provides  the  criterion  for  admitting  data 
to  the  computer.  A correlation  value  exceeding  T is  con- 
■'erted  to  digital  form,  assembled  into  a 30-bit  word  along 
with  the  appropriate  range,  bearing,  and  range-rate  informa- 
tion, and  is  then  entered  into  the  TDS  (temporary  data 
storage)  list  in  computer  memory.  Correlation  values  exceeding 
T . and  sometimes  the  corresponding  data  words  will  hereafter 
be  referred  to  as  "events."  The  TDS  list  has  a capacity  of 
4096.  T is  adjusted  automatically  by  the  computer  to  keep 
the  average  input  rate  such  that  the  computer  is  always 
vrorking  near  its  raaximi.im  capability.  Tliis  is  roughly  equi"- 
alent  to  filling  TDS  once  per  ping  with  T fixed  to  select, 
on  the  average,  1.8  per  cent  of  the  correlation  values. 

(1.8  per  cent  of  224,000  is  4032,  lea-^ing  a little  leev’-ay  to 
avoid  overflowing  TDS.  The  overflow  problem  will  be  discussed 
later.)  T will  be  assumed  fixed  (at  the  1.8  per  cent  setting 
unless  otherwise  noted)  throughout  this  report. 
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Prior  to  entry  into  TDS,  correlation  'values  are  submitted  t .' 
a second  threshold  (analog),  called  "P , " wliich  is  set  higher 
than  T . P is  the  criterion  for  believing  that  a particular 
event  which  has  exceeded  T (and  will  thus  he  entered  into 
TDS)  should  be  singli^d  out  for  further  analysis.  E'.'ents 
exceeding  P are  distinguished  by  having  an  indicator  bit. 
which  will  be  called  the  "P-bit,"  set  to  one.  P is  adjusted 
automatically  by  the  computer  and  it  is  expected  that  one  or 
two  per  cent  of  the  words  in  TDS  will  have  a P-bit  of  one. 

The  entering  of  data  into  the  TDS  list  in  the  computer  may 
be  summarized  as  follows.  On  the  average.  4032  events  are 
entered  into  TDS  per  ping.  An  event  may  have  a P-bit  of 
zero  or  one,  one  of  sixteen  bearings,  and  one  of  eight  range- 
rates.  For  the  purposes  of  this  report,  it  is  assumed  that 
the  ranges  entered  are  in  U-yard  increments  and  are  actual 
ranges  of  the  returns  being  correlated.  (Since  the  outer 
edge  of  the  third  zone  occurs  nominally  at  300  seconds  or 
240,000  yards,  there  are  60.000  range  increments  and  ]6  bits 
would  be  required  to  enter  the  ranges.  Actually,  only  ly 
bits  are  used  and  the  ranges  are  entered  in  '“-yard  increments. 
This  difference  will  not  affect  the  analysis  below  and  will 
therefore  be  neglected.)  Since  T is  set  to  accept  l.“  per 
cent  of  the  correlation  values,  one  event  is  entered  into 
TDS  for  each  56  correlation  values,  on  the  average.  Range 
is  a non-decreasing  quantity  from  the  beginning  to  the  etid 
of  the  list,  though  several  events  may  be  entered  at  the 
same  range;  however,  the  beams  will  generally  be  stepped 
through  several  times  between  events,  and  it  is  reasonable 
to  expect  that  the  bearings  of  the  events  in  TDS  will  occur 
in  essentially  random  order. 

The  computer  program  will  now  he  described  in  rreater  deta’l. 
The  basic  concept  underlying  this  program  is  the  "clustei’." 

In  general,  it  is  expected  that  a siibmarine  target  (and 
perhaps  some  nonsubmarine  ob.iects)  will  return  a set  of 
events  which  are  grouped  (clustered)  in  range,  bearing  and 
range-rate.  This  expectation  is  based  on  three  asstmpt ions ; 
(l)  that  echoes  from  strong  targets  will  often  appear  on  two 
or  more  beams  because  of  receiving  beam  overlap;  (2)  that 
an  extended  target  such  as  a submarine  will  return  echoes 
at  several  ranges,  since  correlations  are  performed  e’^ery 
4 yards;  and  (3)  that  a spatial  cL;)&+.er  In  ranrc  and  bearinv 
produced  by  a real  target  will  exhibit  more  'nternal  range- 
rate  consistency  than  a cluster  produced  by  random  back- 
ground. A preliminary  perusal  of  the  fairly  large  set  of 
submarine  echoes  obtained  with  a limited  noise-correlation 
system  during  the  most  recent  trials  with  the  USS  BAYA 
(summer  cruise,  July  and  August  1Q6o)  appears  to  support 
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these  :iss' rapt  •■ms  . A detailed  statistical  analysis  of  these 
data  is  presently  undenray.  The  cluster  concept  is  of  consid- 
erable Interest  in  relation  to  both  detection  and  classifica- 
tion, and  it  is  the  razson  d'etre  of  the  analysis  reported 
here.  It  should  be  kept  in  mind  that  the  cluster,  as  it  is 
discussed  in  this  report,  is  a single-ping  detection  criterion. 

The  program  proceeds  as  follows.  The  TDS  list  is  searched 
until  an  event  with  a P-bit  of  one  is  found.  This  event 
(call  it  event,!)  is  submitted  to  a third  threshold  (digital), 
called  "M,”  which  is  set  quite  high.  M is  the  criterion  for 
retaining  an  event  on  the  basis  of  correlation  amplitude 
alone.  This  is  necessary  because  a beam  aspect  target  in 
the  center  of  a receiving  beam  may  produce  only  one  or  two 
e^rents,  but  these  are  likely  to  be  of  particularly  high  ampli- 
tude . If  event  ,4  exceeds  M ^ all  events  in  a range  interval 
of  about  100  yards  and  a bearing  interval  of  four  beams 
(called  a "cluster-sized  region"  hereafter)  about  event  A 
are  stored  as  a cluster  in  the  PTS  (possible  target  storage) 
list  in  computer  memory.  The  exact  manner  in  which  the 
100-yard  interval  and  the  four  beams  are  selected  is  not  of 
importance  here . 

If  event  A does  not  exceed  M , it  is  considered  as  a member 
of  a possible  cluster.  The  TDS  list  is  searched  to  determine 
whether  a set  of  events  meeting  the  necessary  cluster  criteria 
is  present  in  a cluster-sized  region  centered  in  some  way 
about  event  A . If  such  a cluster  is  found,  it  is  entered 
into  PTS.  If  not,  event  A is  discarded  and  TDS  is  searched 
for  a new  event  with  P-bit  of  one.  Then  the  above  procedure 
is  repeated.  After  TDS  has  been  completely  searched  in  the 
manner  described  for  a sequence  of  pings,  PTS  contains  the 
events  needed  for  the  visual  track-detection  display  men- 
tioned earlier. 

The  present  criteria  for  selecting  a set  of  events  as  a 
cluster  for  entry  into  PTS  will  now  be  described.  The  first 
step  is  to  set  up  the  appropriate  range  and  bearing  limits 
around  event  A ; i.e.,  to  delimit  the  cluster-sized  region 
to  be  studied.  Then  the  number  of  events  (including  event 
a)  in  the  region  is  counted.  Four  bearing  confidence  levels 
(BCD's)  are  assigned  on  the  basis  of  this  count  as  follows: 

If  the  count  is  1,2,  or  3>  BCD  0 is  assigned;  if  the  count 
is  4,  5jOr  6,  BCD  1 is  assigned:  if  the  count  is  7 or  8, 

BCD  2 is  assigned:  and  if  the  count  is  9 or  greater,  BCD  3 
is  assigned.  The  criteria  given  here  for  BCD  assignment 
supersede,  tentatively,  those  shown  in  figure  8 of  reference  1. 
These  two  sets  of  criteria  are  compared  in  the  section  on 
"Control  of  Rilse  Alarm  Rate,"  to  follow.  If  BCD  is  0,  the 
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cloister  is  discarded.  If  BCL  is  3?  the  cluster  is  entered 
into  PTS  without  further  tests. 

If  BCL  is  1 or  2,  the  events  are  tested  for  range-rate 
consistency  and  a range-rate  confidence  level  (RRCL)  is 
assigned.  At  present,  a sequential  procedure  for  assigning 
RRCL  is  being  considered  and  this  procedure  is  the  one  that 
will  be  described  and  analyzed  belov;.  (An  alternate  proce- 
dure, which  may  vrell  be  adopted  in  the  future,  is  described 
and  analyzed  in  Appendix  A.)  First,  a count  is  made  of  the 
number  of  events  (including  event  A ) having  the  same  range- 
rate  as  event  A.  If  the  count  is  1,  a count  is  made  of  the 
number  of  events  in  the  6-knot  range -rate  Increment  above 
that  of  event  A.  If  this  count  is  0 or  1,  a count  is  inade 
for  the  6-knot  increment  below  that  of  event  A . If  this 
final  count  is  0 or  1,  RRCL  0 is  assigned  and  the  cluster 
is  discarded.  Now,  suppose  a count  of  2 or  greater  is 
obtained  during  the  procedure  outline.  In  this  case,  the 
procedure  is  halted  and  a range -rate  confidence  level  is 
assigned  as  follows:  If  the  count  is  2,  RRCL  1 is  assigned: 
if  the  count  is  3j  RRCL  2 is  assigned;  and  if  the  count  is  4 
orgreater,  RRCL  3 is  assigned.  If  RRCL  is  3>  ihe  cluster 
is  entered  into  PTS  without  further  tests . 

Thus  far  in  the  program,  the  following  decisions  have  been 
made:  (l)  clusters  with  BCL  0 have  been  discarded:  (2) 

clusters  with  BCL  3 have  been  entered  into  PTS:  (3)  clusters 
with  BCL  1 or  2 and  RRCL  0 have  been  discarded:  and  (4) 
clusters  with  BCL  1 or  2 and  RRCL  3 have  been  entered  into 
PTS . The  clusters  still  to  be  sorted  are  those  with  BCL  1 or 
2 and  RRCL  1 or  2.  The  decisions  for  these  are:  (5)  clusters 
whose  confidence  levels  sum  to  less  than  3 are  discarded: 
and  (6)  clusters  whose  confidence  levels  sum  to  3 cu’  greater 
are  entered  into  PTS.  These  six  decisions  have  been  presented 
roughly  in  the  order  they  are  made  in  the  program.  It  is 
noted  that  decision  (6)  actually  subsumes  all  the  others,  so 
that  the  selection  of  clusters  may  be  described  in  terms  of 
this  single  decision  or  criterion  (BCL  + RRCL  ^3)' 

The  above  discussion  of  confidence  levels  and  decisions  may 
be  simimarlzed  with  the  aid  of  table  1. 

Table  1.  liatrix  of  Confidence  Level  Combinations. 
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Coiiibination  4 is  Impossible.  Decision  (l)  discards  combina- 
tions 1,  2 and  3-  Decision  (2)  accepts  combinations  13  - l6. 
Decision  (3)  discards  combinations  5 and  9-  Decision  (4) 
accepts  combinations  8 and  12.  Decisions  (5)  and  (6)  discard 
combination  6 and  accept  combinations  7,  10  and  11 . The 
complete  criterion  BCD  + RRCL  ^ 3-  course,  accepts  all 
possible  combinations  on  or  below  the  secondary  diagonal  of 
the  matrix. 

Tlie  central  question  raised  by  the  cluster  concept,  assuming 
that  the  cluster  model  is  appropriate  to  submarine  echoes, 
is  that  of  false  alarm  probability:  How  likely  is  it  that 
a cluster  meeting  the  criteria  described  above  will  be 
produced  by  noise,  reverberation,  or  false  targets?  This 
question  must  eventually  be  answered  with  a reasonable  degree 
of  confidence  if  we  are  to  specify  computer  information  rates, 
threshold  settings,  and  display  techniques  which  are,  in  some 
sense,  optimum.*  This  report  makes  an  initial  contribution 
toward  that  end  by  investigating  in  detail  the  effects  of  ran- 
dom background.  It  is  felt  that  this  analysis  covers  the  effects 
of  both  random  noise  and  random  reverberation.  Independent 
analysis  pertinent  specifically  to  reverberation  has  also 
been  undertaken . 3 

The  following  topics  will  be  discussed  here: 

1 . The  probability  of  observing  exactly  K events  in  a time 
inter-ral  t if  the  events  occur  at  random  instants  in  time. 

The  results  are  applied  to: 


* 

The  companion  question  to  be  answered  is,  of  course,  that  of 
detection  probability:  How  likely  is  it  that  a submarine 
target  which  ventures  within  the  ocean  vol:.une  being  searched 
by  the  Lorad  system  will  be  detected?  The  false  alarm  contribu- 
tions of  noise  and  reverberation  are,  for  the  most  part,  suscep- 
tible to  analytical  treatment.  On  the  other  hand,  the  primary 
questions  associated  with  real  and  false  targets  must  ultimately 
be  answered  on  an  empirical  basis:  they  are  intimately  connected 
with  the  physical  properties  of  the  target,  the  medium,  and  the 
propagation  path,  as  well  as  with  the  processing-gain  of  the 
Lorad  system  and  the  appropriateness  of  the  detection  model  (the 
cluster  model,  in  this  case)  being  used.  It  is  hoped  that  an 
analysis  of  the  data  collected  during  the  recent  sea  trials 
mentioned  earlier  will  provide  tentati^^e  answers  to  some  of 
these  questions. 
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Li.  Tlie  probability  distribution  of  the  number  of  events  in 
TDS.  Tlie  probability  of  overflowing  TDS . 

b.  Tlie  probability  of  a false  alarm  being  produced  by 
random  noise  at  the  correlator  outputs.  False  alam  rates 
for  the  Lorad  system. 

2.  The  probability  distribution  of  the  time  inter\^ls 
between  events  which  occur  at  random  instants  in  time.  The 
results  are  applied  to  the  time  intervals  between  events 
entering  TDS. 

These  results  are  presented  in  the  following  sectionj,  Theory 
and  Applications.  Monte  Carlo  experiments  verifying  the 
basic  probability  distributions  used  below  are  described  in 
Appendix  B. 


THEORY  AND  APPLICATIONS  : 

i 

i 

L . ASSUMPTIONS  | 

i 

i 

The  starting  point  of  this  analysis  is  the  sequence  of  s 

correlation  values  presented  to  threshold  T.  These  correlation  j 

values  are  considered  to  be  produced  as  the  result  . f random  j 

noise  at  the  Inputs  of  the  signal  deities.  It  is  assumed  ’ 

that  the  correlation  values  may  then  be  treated  as  samples  of  j 

a stationary  random  process . It  is  further  assumed  that  con-  j 

secutlve  correlation  values  (i.e.,  correlation  values  separated  I 

by  one  4-yard  range  increment  in  a single  beam)  are  independent.  1 

Although  this  latter  assumption  might  be  somewhat  suspect  since  | 

the  true  range  resolution  of  the  Lorad  system  is  8 yards  rather  1 

than  h yards,  the  assumption  is  Justified  for  the  purposes  of 
this  report.  If  the  two  assumptions  stated  above  are  accepted, 
along  with  a fixed  (percentage)  setting  of  t , the  questions 
posed  in  the  Introduction  can  be  completely  answered  without 
any  information  concerning  the  amplitude  distribution  of  the 
correlation  values;  therefore,  this  distribution  will  not  be 
discussed  except  in  Appendix  B on  the  Monte  Carlo  experiments . 

This  feature  lends  a considerable  amount  of  generality  to  the 
analyses  presented  below. 

2.  THE  POISSON  DISTRIBUTION 


Consider  a sequence  of  events  which  occur  at  random  times  and 
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which  obey  the  stationarity  and  independence  assiimpt"' ons 
stated  above.  The  probability  P (ft;  \t  ) of  I'b.d'rif^  exact!,, 
ft  events  in  an  interval  of  length  t is  given  by  the  Poisson 
distribution^ 


P ( ft ; X t ) 


(Xt)" 
ft  : 


exp  ( - X t ) 


(1) 


If  5 denotes  the  number  of  events  obser^.’’ed,  (l)  gives  the 
probability  that  5 - ft,  a statement  which  will  be  written 


Pr  Ls  = ft}  = P (ft;  Xt  ) (2) 

The  mean,  second  moment,  and  variance  (second  central  moment) 
of  the  Poisson  distribution  are,  respectively, 5 


p = = Xt  (3) 

= Xt  ( X t + ; ) ( X ) 

0^  ' ^2  = 1^2  ~ 


From  (3)'  we  see  that  X is  the  mean  n' mber  of  e-'ents  per 
nit  time. 


3.  NUI-IBER  OF  EVENTS  IN  TDS 


The  Poisson  distribution  will  be  used  to  determine  the  prob- 
ability distribution  of  the  number  of  events  entered  into 
TDS  for  a single  ping.  The  probability  of  overflowing  TDS 
wihh  a single  ping  will  also  be  derived. 

For  convenience,  we  divide  time  into  intervals  of  length  tQ 
(5  milliseconds)  corresponding  to  the  U-yard  range  increments 


^For  a thorough  presentation  of  the  Poisson  distribution  with 
numerous  applications,  see  Chapter  6 of  reference  4. 

''The  moment  notations  employed  here  are  those  used  in 
Chapter  > of  reference 
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between  correlations.  In  a single  beam,  the  number  of  events 
oi.t-crea  into  'fD.'l  per  interval  £q  is  either  0 or  1.  The  mean 
number  of  events  per  beam  per  inter"/al  £q  is  O.OI8  (since  the 
T threshold  is  assumed  set  to  select  1.8  per  cent  of  the 
correlation  values).  From  (3)..  then,  the  mean  number  of 
events  per  beam  per  unit  time  is 


Xq  --  0.018/£q 


I 

(6)  i 


For  the  full  56,000  yards  of  ranj'e  coverage,  the  total  time 
Interval  is  £ = ih.OOO  £q  and  Xq£  = 252.  Thus,  the  probabil- 
ity of  entering  exactly  k events  per  ping  into  TDS  from  a 
single  beam  is 

P{k-.  252)  = exp(-  252)  (7) 


For  all  16  beams,  the  mean  number  of  events  per  unit  time  is 


Xy  = 16Xq  = 0.238/£q 


(8) 


and  Xyi-  4032.  Finally,  the  probability  of  entering  exactly 
k events  per  ping  into  TDS  is 


P{k-,  4032)  = exp(-  4032)  (9) 

From  (3)  and  (5),  the  mean  number  of  events  per  ping  is  4032 
and  the  standard  deviation  (o)  of  the  number  cf  evei.ts  per 

ping  is  (4032)^^63.5. 

It  is  seen  that  the  size  4096  chosen  for  TDS  is  approximately 
one  standard  deviation  greater  than  the  mean  or  expected 
number  of  events.  The  probability  of  overflowing  TDS  on  a 
single  ping  is 


00 

Pr(5>  4007)=  / p{k\  4032). 

k = 4097 


(10) 
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Cleat'ly.  tVie  direct  evaluation  of  (lO)  would  lie  quite  dilficult. 
Foi-tiinately . the  Poisson  distrihutlon  may  he  approximated  hy  a 
(.laussian  (or  noniial)  probability  density  function  when  the 
value  of  X is  large  enough.* 

Tb.e  standard  (zero  mean  and  unity  standard  deviation)  Gaussian 
density  function  is 


(.x)  (pk')*^  exp(-  j:  ,'2)  (n) 

and  the  corresponding  (cumulative)  distribution  function  is 

d)(jr)  = i!){y)dy  (12) 


For  a Poisson  process  with  parameter  where  ■.  is  large,  we 
can  make  the  following  approximation:  the  probability  that 
the  number  of  events  observed  in  an  interval  of  length  t will 
fall  between  a and  h is 

b 


Pna  < S < b)  = 


^ Pik:  ’-t) 
k = a 


(T> 


b - ht  + 

- (Xt)5 


- H 


- X? 


(xb)' 


(13) 


In  the  case  b = as  in  (lO),  (13)  reduces  to 


PrS  > a} 


Xt )"" 


0 

-J 


(iM 


Returning  now  to  the  overflow  problem.  (l4)  allows  us  to  write 
the  overflow  probability  in  (lO)  in  the  form 


Pr\S  > <2}  ~ 


- to32.3  ] 

63.5  J 


(1^) 


*.See  rel'.  4^,  Chapter  '( 
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whejfe  a is  one  in’ea-ter  than  the  size  a^jsl.-'ned  to  TDS.  Fquatioi; 
15  I'i-ves  the  protiability  of  ovei'f  low  In;'  a TD.I  list  of  size 
4096  (a  4097)  as  0.15',  . 

Tlie  effect  of  increasing  the  size  of  TDS  (assuiJiln,-  the  T 
threshold  still  fixed  at  the  1.8  per  cent  settir.r)  on  the 
probability  of  overflow  is  indicated  in  figure  1.  A scale 
for  T has  been  included  at  the  right  edge  of  this  fhnjre; 
this  scale  indicates  the  effect  of  decreasinr.  T with  the 
size  of  TDS  fixed  at  4096.  Here,  T is  expressed  in  prolahll- 
Ity  fonn  (f  - 0.0l8  corresponds  to  the  1.8  per  cent  settir.r). 


4.  CONFIDENCE  LEVEL  PROBABILITIES 


In  this  section,  we  will  develop  various  probabilities 
associated  with  the  bearing  and  ran.;e-rate  confidence  levels 
of  a cluster.  These  will  be  employed  in  the  next  section  to 
detennine  the  probability  of  a false  alanii.  We  be-i'in  by 
calculating  the  probability  distribution  of  the  number  of 
events  in  a cluster-sized  region  B having  a range  extent  of 
108  yards  and  a bearing  extent  of  four  2°  beams. 

For  108  yards,  t - 2TtQ.  For  a single  beam,  equaticri  6 
gives  \ gt  - 0.486.  The  prolab  i 1 Ity  of  findin,-:  exactly  k 
events  in  a 108-yurd  range  interval  for  a sin-'le  learn  Is 

p{k-.  0.486) 


For  four  beams.  4XQi 
exactly  k events  in  R 

P[k\  1.944) 


Probabilities  calculated  using  (l6)  and  (iT)  are  tabulated 
in  the  second  and  fourth  columns  of  table  2 and  are  plotted 
using  filled  circles  and  triangles  In  fiigvir;  2.  Tlie  Monte 
Carlo  data  will  be  discussed  later. 


exp  (-  0.486) 


(lO 


1.944  and  the  probability  of  findinv 


is 


= 0.143 


(1  -9^14)^ 

k\ 


(17) 
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PROBABILITY  OF  OVERFLOW 


Figui’e  i.  Probability  of  overflowing  TDS  storage  List. 
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Table  2.  Spatial  cluster  probabilities. 


k 

[ Pik:  0. 486 ) 

Data 

P {k;  1 . 944 ) 

P{k) 

0 

0.615 

0.642 

0.143 

0 

1 

0.299 

0.293 

0.278 

0.324 

2 

7.26  X 10'^ 

5.68  X 10"^ 

0.270 

0.317 

3 

1.18  X 10"^ 

0.8  X 10'^ 

0.175 

0.204 

4 

J .43  X 10"^ 

0.5  X 10'^ 

8.51  X 10'^ 

9.93  X 10"^ 

5 

1.39  X 10'^ 

-4 

1.0  X 10 

3.30  X 10'^ 

3.35  X 10'^ 

6 

1.13  X 10“^ 

0 

1.07  X 10"^ 

1.25  X 10'^ 

7 

1 

2.97  X 10'2 

3.47  X 10"- 

8 

7.24  X 10'^ 

8.45  X 10"^ 

9 

1 .56  X 10'^ 

1.82  X 10"^ 

10 

3.03  X 10'^ 

3.54  X 10"^ 

The  probabilities  P{)^ l.^kk)  may  be  used  to  determine  the 
probabilities  of  ob'taining  each  of  the  U bearing  confidence 
levels  for  a given  cluster.  However,  1.9^4)  cannot  be 

used  directly  becau.se  a cluster  must  have  at  least  one  event 
in  it  (i.  e.,  the  ^ - 0 case  does  not  occur).  To  account  for 
this  situation,  we  define  a spatial  cluster  probability  P( 
as  follows : 


(O  = 


0,  * = 0 


1 - P (0;  1.944) 


(18) 


p{k;  1.944) 


[ =1.167  P(k;  1.944),  k > 1 


These  probabilities  are  listed  in  the  final  column  of  table  2. 
The  confidence  level  probabilities  p(BCL)  are  now  given  by 
sums  of  the  P{k)'s 


Pr(BCL=0)  = Pr(;c=i}  +Pr(^=2)  + Pr{*=3)  (19) 
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PriBCL-  L)  •-  Pr,k  4j  + PnA^5i  +Pnk=6l  (20) 


Pr;.BCI.--=2]  - Pr.A-Ti  + 2 r.A  8j  (2l) 


‘iBCL--=3i  = Pr,k  > 9J  = ] - ) Pr.BCL-  iJ  (22) 

i 0 


and  are  presented  in  table  3- 


Table  3-  Bearing  confidence  level  probabilities, 


A 

BCL 

P(BCL) 

1,2,3 

0 

0.845 

'+,5,6 

1 

0.1503 

7,8 

2 

4.315  x 10 

>9 

3 

3.85  X 10 

-3 


Hie  next  step  is  to  compute  uhe  probabilities  of  the  range - 
rate  confidence  levels.  Since  RRCL  is  a function  of  h,  the 
number  of  events  in  the  region  B,  we  begin  by  determining 
the  conditional  probabilities  (URCL  ] •■) : i.e.,  the  probabil- 
ity of  RRCL  given  the  value  of  k. 

We  recall  that  J,  2 or  3 of  the  eight  range-rate  channels 
are  examined  in  assigning  RRCL.  It  will  be  assumed  that  an 
event  produced  by  random  noise  may  have  any  of  the  eight 
possible  range -rates  with  equal  probability.  The  following 
probability  model  is  applicable  here.  Consider  k indepen- 
dent trials  of  an  experiment  having  eight  possible  mutually 
exclusive  equally  probable  outcomes.  Of  these  outcomes. 

3 specific  ones  (call  them  outcomes  1,  2.  and  3)  are  of 
interest.  The  probability  of  obtaining  k^  trials  with 
outcome  1,  Ag  trials  with  outcome  2 and  krt  trials  with 
outcome  3 is  given  by  the  multinomial  distr'.tiutu.-i'  wbL-')  . 
for  the  present  case,  may  be  v^ritten 


kl 


’(a  A_,;r_;A)  ^ (—) 

\ 1’  2’  3’  k '.k'k'k,  : 

...2  3'+ 


n At  Aj;  + A ^ ; 


(23) 


*See  ref.  4,  Chapter  6. 
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Her-.  . 


k + -V  k k , k (2h) 

\ 

riiid  k '3  treated  :iS  tlie  purrrieter  - tire  distr  rrut : -ir. . 'Pl.e 
probabi ! itiet;  faiven  by  (23)  ha-.-e  i cti.  computed  fjr  a.;  choice 
r ^ . k^  and  k^  for  k 2,...,  . Tlierc  -ire  ioOC  of 

tlieoe  cases,  of\’'hich  2^'^  axv  distinct  (there  is  some  redun- 
dancy. since  k .,  k^  and  k^  are  indistin-Tuishab  .e  as  fur  as 
(23)i3  concerned). 

Tliese  multinoml  a ! probabilities  ;riiy  be  used  t-  compute  the 
conditional  probabilities  f(RRCL  i^).  Hiwever.  here  a.fuin 
the  basic  mathematical  mode'  must  be  modified,  in  this  case 
because  k^  : 0 does  not  occur,  ki  i cases  in  which  k-^  - 0 
are,,  therefore,  assigned  a pr.obabii.ity  of  0 and  the  probabil- 
ities for  the  remaining  715  eases  are  appropriately  adjusted, 
corresponding  t.J  the  modification  :;i  (l3)  for  the  bearini' 
cot.fidence  level  model.  The  probabilities  7’(RRCL.l>r)  obtained 
from  these  modified  multinomial  probabilities  are  gi'.'en  in 
table  . To  compu  te  them,  each  of  the  715  multinomial  cases 


Table  Conditional  probabilities  i’(RRCLift) 
for  sequentl-al  procedure. 


k 

RRCL 

R(RRCLi;^) 

1 k 

RRCL 

R(RRCL  I^r' 

0 

cL 

0 

0.9322 

1 

U 

L 

6.652  X lu 

cL 

f- 

2 

0 

3 

0 

0 

0 

3 

0 

.:.--3-’i 

4 

0 

0.7195 

• ■r;2 

1 

0.2579 

CL 

■ . X lO"- 

2 

2.124  X 10-2 

0 

i 

3 

; .P97  X 10-^ 

4." 

0 

U.6032 

6 

0 

0 . 4929 

1 

^ .34.-34 

1 

0 . 4221 

2 

4.572  X 10-2 

1 

2 

7.693  X 10-2 

”3 

; 

2.  -‘..H6  X 10-3 

3 

1.354  X 10-2 

7 

0 

0.395? 

0 

0 

0.3113 

1 

0 . 476C 

1 

0.5130 

. 1 116 

2 

0 . l46? 

•3 

1.653  :<  10-2 

3 

2.386  X 10-2 

0 

::.26]2 

10 

0 

0 . 184-5 

1 

.'iSSS 

1 

0.5405 

2 

^ . 1 102 

2 

0.2109 

3 

4.477  X 10-2 

3 

6.396  X 10-^ 
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wus  assigned  to  the  appropriate  RRCL  (A,  was  considered  to  i'e 
the  nimiber  of  events  having  the  same  I’anre-i’ate  as  event  A: 

*2  tile  niuniier  having  the  next  hi, 'her  rar.ge-rate.  and  the 
number  having  the  next  lower  rant't -rate) . ai;d  the  protiat  1 1 ities 
for  a given  k and  RRCL  were  then  summed. 

The  conditional  probabilities  in  table  4 >nay  be  used  to  compute 
the  over-all  probabilities  of  the  range-rate  confidence  levels 
as  follows: 

/-(RRCL)'-  PfRRCLl*)  P(A),  (25) 

Z—i 

k - 1 

where  P{k)  is  given  in  the  last  column  of  table  2.  These 
probabilities  are  presented  in  table  5- 


Table  5-  Range-rate  confidence  level  probabilities 
for  sequential  procedure . 


RRCL  °(RRCL) 

0 0.8913 

1 0 . 1001 

2 6.583  X 10" 

3 4.311  X 10“" 

The  products  within  the  summation  in  (25)  are,  of  course, 
.joint  probabilities:  i.e.,  the  probability  of  obtaining  a 
given  RRCL  and  a given  k is  written 

P(RRCL,;r)  = P(RRCLlA-)  P{k)  (26) 

Equation  25  is  written  as  an  approximation,  since  values  of 
k greater  than  10  have  been  neglected  in  the  above  calcula- 
tions. Subtracting  the  sum  of  the  probabilities  in  the 
final  column  of  table  2 from  1 gives  the  probability  that  k 
will  exceed  10  as  I.676  x lO”^,  so  the  error  introduced  by 
this  approximation  is  slight. 


20 


CONFIDENTIAL 


CONFIDENTIAL 


FALSE  ALAll’-'.  PROBABILITY 


For  the  purposes  of  this  analysis,  a false  ananr.  !s  defined 
as  a cluster  which  is  produced  by  randon;  noise  and  which 
meets  the  criteria  for  entry  into  PTS.  For  simpiiclty,  the 
M threshold  will  be  neglected  (this  is  tantamox.nt  to  assum- 
ing a very  high  setting  for  A/)  and  v;e  v^ill  assume  that  all 
ciusters  are  tested  by  the  confidence  level  criteria 
discussed  above.  Tlie  probability  of  a false  alarm  Pp^  is, 
then,  defined  as  the  probability  that  a cluster,  centered  on 
a given  e'.'ent  which  exceeded  the  P threshold,  meets  the 
confidence  level  criteria  for  entry  into  PTC. 

Returning  now  to  the  discussion  of  the  decisions  made  by  the 
computer  {cf.  the  paragraph  containing  table  1 in  the  Introduc- 
tion), we  see  that  we  can  write 

PrlBCL  + RRCL  >3)  (27) 


An  equivalent  statement  Is  that  all  confidence  le'.'el  combina- 
tions on  or  below  the  secondary  diagonal  of  the  matrix  in 
table  1 lead  to  acceptance  of  the  cluster  (i.e.,  a false 
alarm),  whereas  all  combinations  above  the  diagonal  lead  to 
rejection  of  the  cluster.  We  proceed,  therefore,  to  determine 
the  joint  probability,  denoted  p(BCL, RRCL) , associated  with 
each  of  the  l6  combinations  in  table  1.  Note  that  p(BCL,RRCL) 
^ p(BCL)  p(RRCL),  since  BCL  and  RRCL  are  not  independent 
variables . These  are  given  by 


P(0,0) 


P(0,1) 

Pd-O) 


pKRRCL=0,  ;r  = l or  2 or  3)  (2?) 

Pr(RRCL--0,  A-l)  + Pr{RRCL--0,  k^2]  + 
Pr{RRCL--0,  *-3] 


pKRRCL  1,  k 

1 or  2 or  3} 

(29) 

Pr(RRCL-0,  k - 

U or  5 or  6 } 

(30) 
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and.  so  on.  The  joint  probabilities  invoiviut;  RKCL  and  « in 
these  fomulas  are  gi'.^en  by  equation  &6.  Tiie  riiatrlx  of  joint 
probabilities  is  given  in  table  6. 


Table  o.  Matrix  of  joint  probabilities  P (BCL, hRCL)  for  seduentia^. 


BCL 


RBCL 

0 

1 

2 

3 

O.Tddb 
O.luOd 
- .634  X 10 
t.043  X 10 


-3 

-5 


5.357  X lO’"^ 
4.430  X .iO'^ 
2.086  X 10'2 

i . 162  X 10 


j .201  X 10 
4.031  X lO 


-3 


5.113  X 10" 

4.027  X 10'^ 


5.3i5(0  X 10 
cs.175  X 10' 
1.041  X 10‘ 


-4 


procedure . 


2,  3 

7 ,.  8 


By  si-Jimiing  the  probabilities  on  or  below  the-  secondary 
diagonal  of  ihis  matrix,  we  obtain 


‘ FA 


= 6 . 06c  X 10 


-3 


(3.) 


'Tlie  false  alarm  probability  in  (3l)  has  been  obtained  for  a 
specific  setting  of  the  T threshold  (l.e.,  l.b  per  cent)  and 
for  specific  confidence  level  criteria.  This  probability 
will  be  applied  in  the  next  section  to  obtain  an  estimate  of 
the  false  alarm  rate  for  the  system,  again  for  these  specific 
conditions . 


C.  FALGE  ALidiM  BATE 


False  ananti  rate  will  be  discussed  here  in  terms  of  the  mean 
or  expected  number  of  false  alarms  per  ping.  A knowledge  of 
the  time  scaje  associated  v/lth  a ping-cycle  then  p- rmits 
conversion  to  false  aaanns  per  second,  fa^s  aiams  per  conver- 
gence zone  pex’  second,  and  so  01.. 

The  fa:se  alarm  probability  in  (3i)  io  the  probability  that 
a cluster,  centei’ed  on  a given  event  which  exceeded  the  P 
threshold,  meets  the  confidence  level  criteria  for  entry  into 
PTo . If  we  also  knew  the  expected  number  of  events  exceed- 
ing p per  ping,  we  could  compute  the  expected  lumber  of 
false  aiams  per  ping,  oupijose  we  assume  that  P is  set  to 
Select  1.0  per  cent  of  the  events  e.xceeding  T.  Then,  from 
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1 

I 


X. 


I 


(o).  the  metia  n ..^;ber  of  cveats  exeeea:;.,^  P aer  '..uiz  tlm 


me  IS 


Xp  - O.Ui  A.„  - 2.bG  X iU'^  t 


' U 


(3-) 


a.nd 


XdS  - 40.32 


The  probability  of  entering  into  TDO  per  ping  exaeti 
events  having  a .°-bit  of  1 is 


.°(A:  40.32) 


(40.32)^ 


exp. ( -4-0.32) . 


(33) 


From  (3i)  and  (32),  the  mean  nunber  la. 
time  is 


3 e a i.a  i’.ms  pe  r . ti  1 


^FA  ' ^Fa\°  " - ^ -LO'-^l^  2.g2  X iO"'  £ 


(34) 


and  Xp^£  - 0.323. 


The  probability  ol  having  exactly  A False  alaimis  per  ning  is 
then 


.°(A;  0.323) 


(4i-o23) 


04  \ A 


A 


exii( -0.323) 


- 0.723- 


: lA 


^0-323 J 

A .’ 


(33) 


The  expected  number  of  faJse  a lams  per  ping,  which  vl.,..  be 
denoted  and  called  the  false  alarm  rate,  is  then 


'V  - 0-32; 


(3c) 
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ixLLiiUvDirjj  iiitm^retation 


iV  ■ L.ao  ; t...i:iLier:3  Qc-scr  1 the  false  aiax’iii  perforihaiice  af 

tiic  lAirad  system  (with  a covei’age  ol'  32"  and  3 convergence 
zones)  ha 'e  oten  'Ltained  ih-oin  the  above  analysis;  (l)  the 
I'a  l.se  Uiarii.  prol. ability  in  (3-1-) : sind  (2)  the  I'alse  aiam 
rate  lii  {iv)  ■ The  r.irii.ei’  Is  detemlned  by  the  T threshold 
setting  (l-'"-  per  cen*'  In  this  case),  by  the  criteria  used  in 
assigning  the  conl'ldence  levels  BCL  and  RRCL,  and  by  the 
Cl  ,ster  ci'iter'..n  applied  to  the  confidence  level  coiubina- 
tl._n,s  (BCL  + RRCL  > 3 in  this  case).  The  latter  is  deter- 
mined ty  these  same  factoi-s  and,  in  addition,  by  the  P 
thx-eshoid  settling  ( 1 .0  per  cent  of  the  events  exceedlixg  T 
In  tlils  case).  The  r.  jiibers  in  (3J-)  and  (3c)  apply  only  for 
one  specific  set  oi'  conditions ; the  next  section  will 
l--'.strate  the  effect  false  aiarit  rate  01'  varying  the 
tl.reshoid  settings,  the  coiu'ldence  level  criteria  and  cluster 
cr i ter  1 on . 

It  i.’.i.st  te  hexit  in  mind  ( c/.  footnote,  P • y)  ) that  false 
aianr:  rate  is  not  a meaningful  Ui.mbei’  b^  itself.  Associated 
wA.h  a given  false  axan:.  rate  is  a detection  probability, 
atid  these  tvio  q. antities  are  generally  "trade-off”  vai-lables. 
if  one  diters  the  pai-a;:ie  ters  ol'  the  system  so  as  to  increase 
the  probability  ol'  detecting  subniariiies , one  should  expect 
to  encountei'  .more  I'a.ise  aiamris  per  ping.  If  one  alters  the 
paronieter  values  to  decrease  the  rate  at  which  false  acarms 
occur,  one  should  expect  to  miss  (fail  to  detect)  more  sub- 
marine targets.  Therefore,  the  results  presented  here  must 
r.lt linatelyf  be  coupled  with  data  on  the  subHiarine  detection 
perforriiince  of  the  Lorad  system  In  order  to  arrive  at  a 
complete  description.  This  description  will  provide  a 
powerf  .-1  tool  for  predicting  and  evaiuatirig  s^.’stem  perform- 
ance under  a variety  of  conditions,  atxd  for  optimizlrig 
system  performance  under  specific  conditions. 


COfJTROL  OF  FALSE  ALlRti  ilATE 


This  section  consldei’s  the  effects  oi,  faise  a^arm  rave  of 
varying  the  confidence  level  criteria,  tlie  ciustei’  criterion, 
and  threshold  settings  enipxoyed  in  the  system.  First,  a 
difl'erent  set  of  criteria  for  assigning  BCL  is  treated: 
second,  several  aitcrriate  cluster  ci’iter'a  ai'e  exanuned:  and 
third,  the  dependence  of  false  alann  rate  on  threshold 
settings  is  discussed. 
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Lut  .'ii  a,ddi.iue  tliuL  BCL  iiJ  ussitjutd  as  I'olluwj  (cf.  the  pi’uce- 
di.re  dedci’lbed  iu  Llie  lutrod; .c tiou)  : ir  tlie  ii  -jubef  of  events 
'll  the  eiudtex'-sized  x'egion  ^ is  1 or  h,  BCL  0 is  u,ssihneci: 

-f  tlie  ooL.nt  Ls  3-  ndj  LfSnt-d:  if  the  cuuiit  Is  4, 

BCL  2 is  assLjitied:  arid  if  the  coent  !j  t f^renter,  BCL  3 
Ls  assie;tied.  T is  assumed  fixed  at  the  ..e  per'  cent  setLiiih 
and  P at  the  1 .0  per  cent  setting".  Tire-  last  C'oi  .mi.  uf 
table  2 yields  a new  set  of  probau  ! i i t ' es  P (BCL)  t;i”er.  in 
table  Y-  Equations  2o,  2V,  anc  3c  (ai.d  the  r'eriia  L n ‘ n^  Jy 
eqi.ations  leading  to  table  c)  i’...st  be  modil’ied  so  that  tiie 
proper  vali.es  of  A appear  in  the  i' igiit-l.and  memter-s  . Tiie 
resulting  Joint  probabilities  p(BCL.ilHCL)  are  gi'.'e;.  ii. 
table  b.  The  sum  of  the  probabilities  oii  or  telow  tne 
secondary  diagonal  of  this  matrix  gi/es  a ne;-.'  x'aise  'a. arm 
probability  of  ;<  10  tills  new  •.■alut  of  leads 

in  turn  to  a new  expected  false  aiari.-i  I'.ate  of  3-41  per 
ping.  Vie  see  that  the  alternate  criter'ia  for  assignir.g  BCL 
increase  the  false  alarm  probability  aiid  expected  I'aise 
alarm  rate  by  a factor  of  about  10. 3- 

oiitiiar  effects  may  be  obse.  d if  chaiiges  are  !i:ade  ir.  the 
cl  ster  criterion  applied  to  the  cunfideijce  level  combina- 
tions. For  e.xample,  the  original  BCL  criteria  vrith  a new 
Cl -Ster  criterion  BCL  + RRCL  > 2 produce  a i‘a..se  ai-aim 
probability  of  3-32  x 10”^  (using  table  6)  and  a fa..se  alai'm 
rate  of  2.23-  Similarly,  the  altei'uate  BCL  criteria  with  a 
new  cluster'  criterion  BCL,+  RRCL  > 3 prod  ice  a false  alarm 
probability  of  3 ■ TO  .x  lO  ^ (using  tab  le  c)  and  a I'arse  alarm 
rate  of  O.L4^. 

The  computations  in  sections  h,  5>  a-bd  fa  leading  to  the 
false  aiarm  rate  and  the  relationship  between  false  alarm 
rate  and  false  alam  probability  may  be  SiCimiarlzed  in  the 
form 


= 224,000  P r (r)  (37) 

P and  T denote  the  threshold  settings  in  probability  fonn 
(O.Ol  and  0.0l8,  respectively,  for  the  conditions  used  to 
obtain  (3J-)  ^nd  (36)).  P„.(P)  is  written  here  to  indicate 

that  Pp^  is  determined  by'  T,  but  is  independent  of  P.  It 
is  seen  that  N„.  is  directly  proportional  to  P.  but  is  not 
linearly  related  to  T.  We  would  expect  to  be  more 
sensitive  to  changes  in  T,  since  an  increase  in  T (lowering 
of  the  T threshold  setting)  would  result  in  an  increase  in 
P_ . . Table  9 presents  false  alarm  probabilities  and  false 
alarm  rates  for  three  settings  of  P . These  results  were 
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obt,a.iued  the  Oi'ijjiiial  coiii'ldeiice  ai.d  cL..;itei‘ 

oi'ileriu,  (i.e.,  those  i.seci  to  obtairi  eq,i.o.', 3-^  3h)- 


TB-ffi  IKTERVAL3  BiT.'/EEN  EVEIITS 


Eliuatloii  i {jives  tlie  probability  of  I’iaaii.;;  cxactJp  k events 


in  an  interval  of  ieiijjth  t.  Tiien 


P{o:Kt)  - exp(-;\t) 


Is  the  probability  of  finding  no  events  in  an  lute  [•'.•a  ^ .h' 

Lentjtli  t.  We  i:n,y  state  this  in  another  equiva.e-nt  v/a^  : 

nation  3b  feives  the  probability  that  the  intei'''aa  ne tween 
two  events  exceeds  t . 

At  this  point,  it  would  be  useful  to  i-eview  the  sit -at ^ n. 
regarding  the  occurrence  of  events  in  tine.  Eltl;er  .■  jr  , 
evezits  can  occui-  in  a time  inter-ai  t , (correspoiidin-;  tn  a 
4-yard  range  interval)  in  a single  beam,  and  '/.'e  hate  acsnrx-J 
that  consecutive  intervals  of  length  are  independen*  . 

From  the  above  discussion,  .°Lt):  , is  tne  probHtiiitj 

that  the  interval  between  events  exceeas  aiij  P[o:  .nt  j 

is  the  prob'-ibility  that  the  interval  between  et'ei,ts  e.v.eeds 
nt  . Thus,  the  probability  P(nc  ,)  that  the  intei-  a*  netwe 
events  Ls  nt^  is  given  by 


- °Lo:  A.{n  - '_-P{o:  ■■.ntj 


.■XpL-x(n  - - eXpC- 


:;c!’(  - .'.n!' ,,  V ■ .i  ■-  ■ . n > . . 


For  a s-ng. 


t ana 


• nt , ! 


n ] , r > 
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For  Lo  be.'ajuo  , -.^,-0 ^ and 

Pfint^)  - 0.334  e.xp( -O.iicJan) , n > i.  (41) 

Evj^uatlon  4l  glveo  Iho  prubability  distribution  of  the  tii/.e 
intei'vuls  betv;ec-n  events  exceeding  the  T threshold.  Equations 
40  and  4i  are  plotted  in  figure  3- 


It  Is  interesting  to  note  that  (3^)  also  be  obtained  by 
approaching,  the  probieiu  from  a more  general  polrit  of  view. 

It  is  known*^  that  if  the  time  interval  between  raiidomiy  occ-r- 
ring  events  is  aiiov/ed  to  take  on  all  values  ('.  .e.,  if  £ is  a 
continuous  variable  ratlier  than  a discrete  one),  tiie  probabil- 
ity density  function  of  tlie  intervals  is 

p ( £ ) - x exp(-;v£).  (42) 


This  is  called  the  exjjonential  density  function  and  the 

IliJIIit'  n,  t S U.  1*6: 


(^3) 

(44) 

V/e  may  now  obtain  (39)  4y  integrating  (42) 
pint  )=  [ ^ p{t)dt 


t 

n - y'/4“' 

J 

u - 1./X 


= exp( -X,n  £ ^)  [exp(A.£^)  - 


],  n > 
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CONCLUSIONS 


1.  Conventloiiu.  1 probability  distributions  and  techniq,ues 
applicable  to  discrete  raridom  variables  iiiay  be  employed  to 
provide  a thorough  analytic  treatment  of  automatic  detection 
processes  in  the  Lo rad  system.  This  treatment  encompasses 
the  use  of  thresholds  for  amplitude  selection  and  computer 
programs  for  cluster  (i.e.,  possible  targets  based  on  single- 
ping  criteria)  selection. 

2.  If  the  threshold  settings  and  clustex-  selection  criteria 
are  specilied^  the  false  alanu  probability  and  false  alarm 
rate  of  the  system  can  be  predicted. 

3.  Since  these  techni^iues  have  been  developed  in  a form 
which  makes  the  analysis  of  a system  essentially  independent 
of  the  amplitude  distributions  involved,  they  shourd  .be 
applicable  to  a wide  variety  of  modern  search  systems.  Both 
analog  and  digital  processes  ax-e  susceptible  to  this  type  of 
analysis.  The  only  basic  limitation  is  that  the  system 
must  process  its  inforcjation  in  a sampled  form;  events  must 
be  presented  to  the  automatic  detection  portioii  of  the 
system  at  discrete  times. 

4.  The  analytic  techniques  developed  above  should  apply 
equally  well  to  automatic  target  classification  processes. 


RECOI-D-IENBATIOKS 


1.  Apply  the  techniques  to  other  sonar  systems:  SQS-23 
modified  for  use  with  Small  Ship  Combat  Data  System  (SSCDS): 
SQS -26 . 

2.  Apply  the  methods  to  tax’get  classif icatior.  processes  in 
Lorad . 

3.  Develop  detection  probabilities  for  the  Lorad  system  and 
Couple  these  with  false  alaxin  characteristics  derived  in  this 
i’eport . 
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APPENDIX  A; 


/VLTEMlilTE  PKUCEDURE  FOR  AEClurilliO  HRCL 


i 

[ A sequential  procedure  for  assigning  RRCL  vfas  descriued  ir- 

f the  Introduction  and  treated  analytically  in  sectioii  4 

[ above.  This  procedure  examines  the  minimum  number  of  range- 

^ rate  channels,  since  it  assigns  RRCL  as  soon  as  it  encounters 

r a channel  containing  two  or  more  events.  Some  opposition 

has  arisen  to  this  procedure  because  it  may  fail  tu  examine 
a channel  which  has  many  more  events  in  it  than  the  channel 
upon  which  RRCL  was  based;  this  would  result  in  assignment 
I of  an  RRCL  which  is  too  small  and,  in  addition,  would  lead 

to  an  incorrect  decision  concerning  the  appropriate  range - 
[ rate  to  be  attached  to  the  cluster  for  display. 


The  most  obvious  alternate  procedure,  which  avoids  these 
objections  entirely,  is  to  examine  all  three  range-rate 
channels  of  intei-est  for  each  event  and  to  assign  RRCL  on 
the  basis  of  the  channel  containing  the  largest  count. 

There  are,  of  course,  other  procedures  vihlch  lie  between 
these  two  in  terms  of  the  extent  to  which  they  circumvent 
the  stated  objections  and  in  terms  of  the  amount  ol'  computa- 
tion time  required,  but  they  need  not  be  considered  here. 


The  most  important  question  which  arises  is;  how  much  does 
the  largest  count  procedure  i-aise  the  probability  of  a false 
alarm?  Clearly  it  viill  increase  Pp, j since  the  RRCL 
assigned  by  the  largest  count  procedure  is  greater  than  or 
equal  to  that  assigned  by  the  sequential  procedure.  The 
computation  of  for  the  largest  count  procedure  has 
been  carried  out,  retaining  the  same  T threshold  setting 
and  BCL  criteria  used  to  obtain  (3i)-  The  basic  multinomial 
model  still  applies,  since  we  are  still  interested  in  three 
of  the  eight  range-rate  channels.  Tables  4,  5,  and  6 are 
replaced  by  tables  10,  11,  and  12. 


Summing  the  probabilities  on  or  below  the  secondary  diagonau 
of  the  matrix  (see  table  i2)  in  accordance  with  (27).  we  obtain 


= fa.  l86  X 10‘^ 


for  the  largest  count  procedure.  Comparison  of  (46)  and  (3j-) 
indicates  that  is,  for  practical  purposes,  unaffected  by 
procedural  modifications  of  the  type  considered  here. 
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lUble  10.  Conditional  probabilities  P(RRCL|a) 
lor  largest  count  procedure. 


(RKCLl*)  I k RRCL  P(r<RCLlA) 


evel  p; 


0 

0.8913 

-P 

1 

9.987  X 10 

2 

6.777  X 10"^ 

3 

4.429  X 10"^ 

Table  12.  Matrix  of  joint  probabilities  i’(BCL,  RRCL) 

for  largest 

count  procedure. 
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,IPP£KDIX  B:  MONTE  CAHLU  EXPERIKEUTC 


The  Tuliowlrtg  Monte  Cui'io  experiments  were  perforined  or.  the 
KTDo  unit  computer  to  check  some  uf  the  dlstj’iDutioiiS  empioyea 
in  the  a.bove  auaiysis;  (i)  generate  a large  set  of  Rayieigh- 
disti'ibuted  samples;  (2)  threshold  the  saniples  to  select  1.6 
per  cent:  (3)  check  the  Poisson  distr-ibution  iii  (l6):  ai.d  (h) 
check  the  e;<ponential  distribution  in  (^O). 


1.  /d-IPLiTUDE  DISTRIBUTION  OF  CORRELATION  VALUES 


It  has  been  demonstrated  above  that  a thorough  analytical 
tx-eatment  of  the  detection  and  false  alanii  perforiiiance  of  a 
system  such  as  Lux-ad  (in  I’act.  any  system  which  has  as  its 
processed  outputs  sequences  of  amplitudes  occurx'ing  at  discrete 
times)  can  be  carx-ied  out  without  detailed  knowledge  of  the 
probability  distribution  of  these  amplitudes.  For  the  purposes 
of  Monte  Carlo  simulation,  howe-rer.  some  amplitude  distx-ibu- 
tlon  had  to  be  selected.  The  correlation  values  at  the  input 
to  the  T threshold  were  assuned  to  be  Rayleigh-distributed, 
an  assxmptlon  wh'ch  appears  to  agi-ee  reasonably  well  with 
experimental  data. 

The  Rayleigh  probability  density  function  will  be  wi-itten 
in  the  foxin 


p (r)  ^ ^ expC-r'^.e).  r > 0. 

X V ~ 

The  moments  of  this  distribution  are 


u'.  = u' 

J J J-2 


M = 


p'  = e 
2 


6^  is,  then  the  RMS  level  of  the  threshold  inputs. 
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2.  GENEMTION  of  ft\YLEIGH  SAJ.IPLE£ 


Programs  to  generate  samples  I'x'uiu  various  distributions  have 
been  written  for  the  NTDS  unit  computer.  Lax-ge  samples  fx’om 
the  following  four  distributions  have  been  successfully 
generated  to  date:  the  rectangular  density  function  (samples 
from  this  distribution  are  called  uniform  deviates) 


PrJ^U) 


J , 0 < ^ < i 
p,  elsewhere 


(^2) 


the  standard  Gaussian  density  I'unction  (samples  are  called 
noniial  deviates)  in  (ll);  the  flayleigh  density  function  in 
(47)  with  0-2 


(r)  - r exp{-r  /2);  (^3) 


ind  the  exponential  density  function  in  (42)  with  > = j 


p{t)  = t exp(-t/2)  (b4) 


The  details  concerning  the  generation  techniques  employed 
will  De  reported  sei:>arately . The  techniques  will  be  described 
vei’y  briefly  here. 

The  rectangular  dlsti'ibutlon  was  generated  first,  using  the 
"congruentia  L”  method.*"  Then,  normal  deviates  were  generated 
oy  adding  ten  of  the  x-ed^ngularly -distributed  numoers  (the 
centx’al  limit  theorem  approach).^  Rayleigh-distributed 
nwnbers  were  generated  by  taking  two  independent  sets  of 
norrimii  deviates,  the  members  of  which  are  denoted  x and ->'q 
f 2 i " 

\ 1 2j 

distributed  numbers  with  X ^ were  generated  by  squaring  the 
Rayleigh-distributed  numbers. 


and  computing  r 


Aixd,  finally,  exponent iall^,- 


It  vxill  be  noted  that  the  Rayleigh-sanip les  are  obtained 
trutiugh  a series  of  successive  appi’oxiraations  . Thus,  these 
samples  will  not  have  a perfect  Rayleigh  distributioii:  in 
particulai’,  the  worst  deviations  from  the  theoretlcat  ixaylelgh 
density  functiur*  are  to  be  expected  for  large  values  of  r, 
slrice  nox’mal  deviates  generated  in  the  nianner  described  do  noi 


34 


CONFIDENTIAL 


CONFIDENTIAL 


agree  vex’y  well  with  (il)  I'oi'  large  values  ol  x.  'Uiere  are 
other  noriiia  1 -deviate-gexierating  teehoidues  vxhich  result  in 
a better  lit  of  the  samples  to  (ll).''  Some  oi'  these  v/ill 
be  prograjiuued.  and  checked  in  the  near  future. 

The  theoretical  Rayleigh  density  function  in  (>3)  is  plotted 
in  figure  h,  along  with  amplitude  distrluution  data  obtained 
from  10,000  computer-generated  samples.  The  theoretical 
moments  for  (53)  given  by  (4^^)  and  (5l)  with  6=2 


M 


1-253 


2 

a 


0 . 42^x2 


(55) 

(56) 


whereas  the  empirical  moments,  denoted  r and  s'^  for  the 
10,000  samples  were  found  to  be 

r = 1.252  (57) 

= 0.419-  (5h) 


It  will  be  seen  that  the  agreement  is  relatively  good,  and 
a x2  test  indicates  that  the  agreement  is  statistically 
acceptable  at  the  5 pen  cent  level  of  significance. 


3-  THRESHOLDED  RAYLEIGH  SAJvIPLES 


The  threshold  value  - 2.834  should  select  1.8  per  cent  of 
the  Rayleigh  samples;  that  is, 

I “ 

I r exp{-r‘^/2'jdr  - 0.018  (59) 

= 2.834 

The  "tail"  of  the  Rayleigh  density  I'unction  for  r > is 
plotted  in  figure  5)  along  with  amplitude  distribution  data 
for  10,000  computer-generated  saniples  which  exceeded 
Here  again,  the  agreement  is  satisfactory,  but  the  predicted 
deviatiori  fx’om  the  theoretical  density  function  for  large 
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Figure  4.  Rayleigh  probability  density  I'unctlor. 
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Figure  5-  Tail  of  Rayleigh  probability  density  fur.ctioi 
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values  of  r is  ouserved.  In  particular,  the  Monte  Cai'io  aaia 
fall  rather  consistently  ueiuw  the  tlic-oretical  curve.  It  was 
found,  in  fact,  that  the  threshold  value  of  2.03^  selected 
only  about  i.b9  P^i’  cent  of  the  Rayleigh  sauiples  instead  of 
1.8  per  cent.  The  effects  of  this  will  be  seen  in  the  next 
t two  sections . 


4.  SPATIAL  CLUSTER  PROBABILITY 
I 

The  Poisson  distribution  In  (l6;  was  checked  by  generating 
10,000  sets  of  27  Rayleigh  samples  aiid  couriting  the  number  of 
samples  exceeding  threshold  in  each  set.  27  is  the  number 
of  4-yard  range  inte-i-.'als  ijj  the  108-yard  intei'val  correspond- 
i.ng  to  a cluster  in  a single  beam.  This  procedure  yielded 
10,000  Poisson  samples,  the  distribution  for  which  is  tabulated 
in  table  2 and  plotted  in  figure  2.  The  theoretical  moments 
are 


u 


0 . 4o6 


(60) 


whereas  the  moments  for  the  10,000  samples  were  found  to  be 


h = 0.A29 

(61) 

^ = 0.410 

(62) 

In  this  case,  the  agreement  is  sufficiently  good  to  bear  out 
the  use  of  a Poisson  distribution.  The  discrepancy  between 
the  data  and  (l6)  is  attributable  to  the  deviation  between 
the  amplitude  distribution  of  the  thresholded  Rayleigh  samples 
and  the  theoretical  density  function.  lii  support  of  this 
rationalization,  it  is  noted  that  if  the  i.8  per  cent  figure 
used  in  (6)  were  replaced  by  1.59  per  cent,  the  constant 
= 0.486  in  (l6)  and  (60)  would  be  replaced  by  0.429, 
which  agrees  with  (6i) . 


5.  TII-'T:  iiitervals  between  events 


To  check  (40),  Rayleigh  samples  were  generated  until  10.000 
had  exceeded  threshold.  In  each  case,  the  number  uf  samples 
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fa i.ed  a 'fder  to  ^ec  a aojaplt  thaf  '.xcc-eutd  threshold 
Was  counted.  The  d is tri Out  ■ on  of  intei'  aio  's  plotted  as  open 
cli-oies  in  figure  j.  Tor  compax-isui.  vi:u.  the  c .rve  fur  P^{nt^) 
The  LlieoreLie'al  moments  fox'  (4u)  ax'e  givt-ii  appi'oxifT-ateiy  by  the 
theoretical  moments  of  (4h)  with  > - U.Oiw 


M - 0 6 (63) 

whereas  the  moments  for  the  lO.UOO  samp.es  wex'e  foutxd  to  be 

^ 63. oy  (64) 

s - b4.4l.  (65) 


xi  1 though  the  agx'eemeiit  between  tixe  data  and  the  theoretical 
distribution  is  relatively  good  iiere.  we  note  that  if  i.fa 
per  cent  is  again  x'ep  laced  by  1 .^y  pex'  cent,  the  numbei' 

.u  in  (63)  is  replaced  by  62. y.  which  agrees  well  with 


APPENDIX  C:  .:LOSS>'vRY 


The  To  LioVf ‘.Ut;  a.  i^iosoLiiv  vjT  the  htislc  Sj^uho.s,  abbre-'isi- 

c!.oris,  0,110.  uoLotLous  eiiipi'.jytd  in  this  report,  in  appr .<x 'iiiate 

order  uT  appearonee . 

T Analog  thresho  d which  selects  events  Tor  entx'y  Into 

TDd  (aj.so  the  probability  that  an  event  v/Ixl  exceed  r ) 

TDS  Teiiipox-ar,,'  data  stox-age  list  in  the  comp. .ter 

P Analog  thx'esljo;d  which  se-xects  the  largest  events 

exceeding  T Tor  Tnx’ther  analysis  (also  the  protabixitp' 
that  an  event  wl.l  exceed  t] 

.4  A pax-tictlax-  event  vxhich  exceeds  ? 

'V  Digital  thresiiOid  which  selects  the  largest  events 

exceeding  P Tox-  retention  and  dlspj.ay  on  the  basis  oT 
amplitude  aiorie 

PTS  Possible  target  stox'age  list  in  the  computer 

BCD  Bearing  confidence  .et'ei 

RRCL  Range -rate  confidence  let'ei 

P{  ) Genex’ax  notation  Tor  the  pr.itability  distribution  of 

a discrete  .ariabxe  or  the  prouabiiity  of  a particular 
■-•a-ue  of  the  •.•ai’lable 

Pr[  } Generaa  notation  for  the  px’obabiilty  of  an  occurrence, 
the  occuri-ence  being  described  inside  the  brackets 


k 

S 


Humber  of  e--ents  - an  integer 

Humbex'  of  events  observed  in  a particular  case 

Parameter  of  a Poisson  d'stribution  (X^.  X^. 

ax'e  special  cases) 
r A 

A time  inteir.'al 

yth  moment  about  zero  of  a distribution 

y'th  central  moment  (about  u)  of  a distribution 

Mean  of  a distribution  (u  nj  ) 


and 


1 


2 2 
0 Vai'iance  of  a.  diatx’ibution  {■.  = ii,  ) ( = otai.aard 

deviation) 

t 5-i“iliisecond  tiiue  intex’vai  correspondiuti  to  a d-yax-d 

range  increiueut 

.r  Random  variable  having  a stuxidard  (ii  - 0 and  - = l) 

Gaussian  (normal)  probability  density  function 

fi{x)  Tlie  standard  (u  = 0 and  o = l)  Gaussian  (noiT;al) 
pi’obabllity  density  function 

cr)(x)  The  cumulative  standax'd  Gaussian  distribution  fui^ctioi. 

R A region  having  a range  extent  of  108  yards  and  a 

bearing  extent  of  four  2°  beoii.s  (cluster-sizeu  regioii) 

False  alarm  probability 
r A 

False  alam  rate 

r A 

n Number  of  intervals  of  duration  t - an  integer 

o 

p(  ) General  notation  for  a probability  density  function 

r Random  variable  having  a Rayleigh  probability  density 

function 

6 Parameter  of  a Rayleigh  density  fui'.ction 

U Random  variable  having  a rectangular  density  fuiiCtioi: 

between  0 and  1 

r The  bax'  is  general  notation  for  the  sample  (empix'ical) 

mean  of  a distribution 

Sample  variance  of  a distribution 
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